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DESIGN BY SPACE TRANSFO RMATION FROM HIGH TO LOW DIMENSIONS 

Field of the Invention 

This invention concerns design by space transformation from high to low 
dimensions. More particularly but not exclusively, this invention concerns 
5 methods and systems for design by transforming data from a high to low 
dimensional design space. 

Background of the Invention 

There are considerable cost benefits to be derived from improving designs 
both by better searches in current design spaces and by satisfying more complex 
10 design criteria, for instance by striking the right balance between multiple 
objectives from the same discipline or from different disciplines. 

In known design processes designers typically spend a prohibitively long 
time preparing individual analysis cases and, are constrained to sampling small 
areas of the design space close to previously explored regions. In such a design 

15 processes, complex design tasks are broken down into manageable portions so 
that specialists in individual disciplines can resolve different parts of the design. 
However, such portions are too small and there is too much iteration between 
disciplines which prohibits the challenging of the constraints of one discipline by 
another, where the most progress is likely to be made. Furthermore, known 

20 design space exploration techniques as applied to complex multi-dimensional 
design spaces are invariably inefficient on account of the associated high 
computational processing cost required for the data analysis. Also, such 
techniques can be problematic to use in complex multi-dimensional design 
spaces because these typically rely on simplistic data analysis models involving 

25 different parameters - for example, numerical errors or uncertainties associated 
with discretisation, incomplete convergence, irregular constraint boundaries can 
arise. The inventors have recognised that this situation can be ameliorated if 
small numbers of individuals can assimilate, appreciate and understand large 
amounts of data rapidly and efficiently. With this in mind, this inventive work is 

30 aimed directly at the designers in the design process of the future, who 
communicate with and steer the design search and optimisation process and who 




XA1762PCT 

A 

-2- 

can extract previous work from databases transparently and flexibly. They can 
use software and data as web services, so that the source of this data and 
software becomes unknown and unimportant. Such designers make use of high 
cost analysis codes within automated search and response surface models to 
5 map and optimise domains using computationally expensive evaluations. They 
can use low fidelity (or computationally inexpensive) models to navigate high 
fidelity design spaces. The placement of analyses in the design space are 
defined by design of experiments (DoE) methods both as schemes defined a 
priori and as a result of optimisation or error-defining processes. These 

10 engineers, armed with more information and understanding, can be expected to 
regularly challenge cross-discipline constraints. They are more concerned with 
problem definition, design space shape and optimisation than how any one 
analysis is obtained and use advanced visualisation techniques to provide 
enhanced comprehension and effective navigation of hyper-dimensional design 

15 spaces. 

Objects and Summary of the Invention 

The present invention aims to overcome or at least substantially reduce 
some of the above mentioned drawbacks associated with known processes. 

It is an object of the present invention to provide a method and system 
20 which are reliable for providing enhanced comprehension and effective 
navigation of multi-dimensional design spaces. 

In broad terms, the present invention resides in the concept of 
transforming data from a high-dimensional to low-dimensional design space and, 
by inspecting the transformed data in the low-dimensional design space, enabling 
25 an optimum value for a functional representation of the transformed data to be 
established, and thereby permitting effective exploration of the high-dimensional 
design space. 

According to a first aspect of the present invention there is provided a 
method of transforming data from a high-dimensional to low-dimensional design 
30 space and deriving an optimum value for a predetermined function representative 
of the transformed data in the low-dimensional design space, which derivation is 
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further effected in the low-dimensional design space in dependence upon an 
inspection of the transformed data. 

According to a second aspect of the present invention there is provided a 
method of transforming data from a high-dimensional to low-dimensional design 
space, and deriving a conditional value for a predetermined function 
representative of the transformed data in the low-dimensional design space, 
which derivation is further effected in the low-dimensional design space in 
dependence upon an inspection of the transformed data. 

It is to be understood here that the terms "optimum value" and "conditional 
value" herein are interchangeably used insofar as they are intended to 
correspond to the highest or lowest value of the functional representation of the 
transformed data in the low-dimensional design space, the particular various 
constraints to the design space problem being further satisfied at the same time. 

In accordance with an exemplary embodiment of the invention which will 
be described hereafter in detail, the optimum/conditional value is derived by (a) 
establishing a mathematical combination of a number of independent design 
variables and dependent design variables relating to the function, and (b) 
modifying the combination in the low-dimensional design space to derive 
therefrom the desired value for the function at which various constraints 
associated with the function are satisfied and at which the function has a 
conditional high or low value in relation to other possible values of the function 
which are determined in accordance with the modification of said combination. 

Conveniently, the transformation into the low-dimensional design space is 
performed by application of a Generative Topographic Map (GTM) technique. It 
is to be appreciated that alternative transformation techniques, the self- 
organizing map (SOM) after Kohonen [13], or the Neuroscale mapping (this is a 
physical distance preserving mapping technique), for example, could be used 
instead for this particular application. 

In accordance with another embodiment of the invention which will be 
described hereinafter in detail, the method comprises the step of transforming 
data from a first high-dimensional design space and from a second, different 
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high-dimensional design space into a low-dimensional design space, comparing 
the different transformed data sets in said low-dimensional design space and 
identifying therefrom similarities between the different transformed data sets to 
indicate a correspondence between the first and second high-dimensional design 

5 spaces. This provides an effective way of assessing the importance and inter 
relationship of design variables in different high-dimensional design space 
problems. In this embodiment, to be described hereafter, the first high- 
dimensional design space is a 5-dimensional design space, the second high- 
dimensional design space is an 8-dimensional design space, the third high- 

10 dimensional design space is a 14-dimensional design space, and the low- 
dimensional design is a two-dimensional design space. It is to be appreciated, 
however, that various other kinds of high-dimensionality design space can be 
readily accommodated, if desired. 

Advantageously, the data transformation into the low-dimensional design 
15 space is performed in a manner which takes account of the effect of each of the 
design variables relating to the function. This makes optional the need for any 
pre-screening of the design variables. 

Optionally, the optimum/conditional value derivation is effected by 
generating an image map representation of the transformed data in the low- 
20 dimensional design space (for example, a 2-D image map representation may be 
generated), and visually identifying an intersecting region in the image map 
representation, which intersecting region provides an indication of said value. It 
is to be understood that the identification step could be performed 
computationally, if desired, so as to provide the required technical effect. 

25 The invention has utility for aircraft design applications and although this 

technology has been developed with reference to aircraft aerodynamic design in 
particular, the design space visualization and curve fitting technology developed 
is general. It should therefore be equally applicable to other disciplines such as 
cost analysis, structures and computational electromagnetics, in which expensive 

30 analysis tools are used to find optima for complicated design problems. It is 
expected to be particularly useful in multi-disciplinary design and situations where 
there are multiple optima in the design space. 
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It is to be appreciated that the present invention may be embodied in software. 
Accordingly, the present invention extends to a computer program element 
comprising program code for configuring a programmable device apparatus or 
system to implement the above described method. Suitably, the computer 
5 program is stored on a carrier medium. 

Further, the present invention extends to a data processing system or 
apparatus for transforming data from a high-dimensional to low-dimensional 
design space adapted and arranged to implement the above described method. 

The above and further features of the invention are set forth with 
10 particularity in the appended claims and will be described hereinafter with 
reference to the accompanying drawings. 

Brief Description of the Drawings 

Figure 1 shows a schematic representation of an RSM-Based Design 
Process; 

15 Figure 2 shows an image representative of a design space for an 

analytical function; 

Figure 3 shows a series of conventional scatter plots; 

Figure 4 shows a set of self-organising maps for a 2-D analytical problem; 

Figure 5 shows an alternative image representation of the image of Figure 

20 2; 

Figure 6 shows the typical result of transforming the image representation 
of Figure 5 into a triangle; 

Figure 7 shows the typical result of transforming the image representation 
of Figure 5 into an SOM; 
25 Figure 8 shows the typical result of transforming the image representation 

of Figure 5 into a GTM; 

Figure 9 shows the typical result of a 50 x 50 evaluation of a 2-D design 
space using a 2-D panel method; 

Figure 10 shows a series of scatter plots for a 5-D military aircraft problem; 
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Figure 1 1 shows a set of self-organising maps for a 5-D military aircraft 
problem; 

Figure 12 shows a 5-dimensional Hierarchical Axes Technique plot; 

Table 1 shows a typical set of results for design space optimisation as 
5 obtained form the Kriging Process; 

Table 2 shows a set of results corresponding to Figure 13 for design 
space optimisation, as obtained from GTM optimisation for a 5-D problem; 

Figure 13 shows an image map representation of transformed data in 2-D 
design space, in accordance with an embodiment of the invention; 

10 Figure 14 shows a loading distribution plot of optimised wing design 

corresponding to an inventive application of an embodiment of the present 
invention; 

Figure 15 shows an image map representation of transformed data in 2-D 
design space, as obtained from GTM transformation of an 8-D aerodynamic 
15 problem; 

Figure 16 shows another image map representation of transformed data in 
2-D design space, as obtained from GTM transformation of a 14D aerodynamic 
problem; 

Figure 17 shows a Hierarchical Axes Technique (HAT) plot of the 6D 
20 Hartmann function; 

Figure 18 shows another image map representation of transformed data, 
as obtained from a 2D GTM transformation of the 6D Hartmann function; 

Figure 19 shows another image map representation of transformed data, 
as obtained from a 4D GTM transformation of the 6D Hartmann function; 

25 Figure 20 shows another image map representation of transformed data, 

as obtained from 4D GTM transformation of the 14D aircraft problem; and 

Figure 21 shows how points on a regular grid in low-dimensional space 
are mapped using a non-linear mapping to corresponding centres of Gaussians. 

Detailed Description of Exemplary Embodiments 
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This invention is to be described in the following way. The 
application of visualisation and design space transformation on a two- 
dimensional analytical problem is described and then extended for use in military 
aircraft design. A two dimensional visualisation of a representative military aircraft 

5 problem is described and then extended to 5, 8 and 14 dimensions. The 
description includes a specification of the optimisation problems and a modus 
operandi for a design process is introduced. The visualisation is compared to 
alternative techniques, such as scatter plots and SOM visualisations. Possible 
applications of the different visualisation methods, in conjunction with response 

10 surface method technology, are also described. The proposed inventive process 
whereby the transformed design space is then used to obtain the optimum in the 
design space is explained. The proposed process and usual process are 
compared for the 5-D problem. It is shown how by implementing the proposed 
process the solving and understanding of multi-dimensional design spaces can 

15 be effectively performed in a two-dimensional image. 

Modus Operandi 

It is to be appreciated that the large amounts of data required for 
design space appreciation can be provided by response surface method 
technology. Visualisation is part of a modus operandi, as shown in Figure 1 . This 

20 comprises first, a problem specification, in terms of objectives, constraints and 
design variables. Then a DoE (e.g. Latin Hypercube [3], LP X [4]) is performed and 
a response surface methodology applied (for instance kriging, radial basis 
functions [5,6,7], etc.). An update strategy is then determined by statistical 
methods, such as expected improvement or the optimum in the domain based on 

25 the visual inspection of maps. As part of this process an assessment takes place 
as to the importance of the design variables in the problem. The inventors have 
found that the first visualisation method proposed ceases to work after about 6 
dimensions. The inventors propose to transform the spaces described from high 
dimensions (5, 8 or 14-D in this case) to just two or four dimensions by use of the 

30 generative topographic map (GTM) (although the exact dimensionality of the low 
dimensional transform is optional). 
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As previously mentioned, the invention is described hereinafter by use of 
two example problems. First, a simple two-dimensional analytical problem, from 
Schwefel's book [1] as described. Secondly, a military aircraft optimisation in 2, 5, 
8 and 14 dimensions is described. More conventional design space appreciation 
5 and response surface fitting methodology is also described. 

Analytical Problem Specification 

A two-dimensional analytical function is chosen so that full appreciation of 
the design space and comparison with the transformations is possible. It is 
assumed that if transformations are poor in two-dimensions then their application 
10 in higher dimensions will be even worse. 

The analytical problem is shown in Figure 2 where the objective function 
(Ob) and the constraints (C* to C 7 ) are defined as: 

Ob(x) = -x t 2 -x 2 2 
C l (x) = -x, 
C 2 (x) = -x 2 

C 3 (x) = -jc, 2 - x 2 2 + 1 7.0*, + 5.0jc 2 - 66.0 
C 4 (*) = -x 2 - x 2 + 1 0.0*, + 1 0.0* 2 -41.0 
C 5 (*) = -x 2 -x 2 +4.0*, +14.0* 2 -45.0 
C fi (*) = *,-7.0 
C 7 (*) = * 2 - 7.0 

In this definition, a constraint is considered satisfied if it is <o.o. The 
15 objective function is not drawn in the domain where any of the constraints are 
violated. The traces show all the evaluations made using an SQP optimisation 
method from multiple starts along the line x ,-3.o The SQP method used was by 
Madsen [1] and based on the Harwell Library Subroutine VE02AD. Alternative 
starts, for example along the Xl =o.o line also find the optimum at [0.5]. The 
20 problem lies in being able to extend plots like this to multiple dimensions. 

The results achieved for this optimisation depend on which constraints are 
active when the problem is solved. The four possible local minima occur where 
the constraint boundaries intersect: 

• x = (0,5), Ob(x) = -25, constraints 1 and 5 active; 

• x = (2. 1 1 6, 4. 1 74), Ob(x) * -2 1 .90, constraints 4 and 5 active; 

• x = (5, 2), Ob(x) = -29, constraints 3 and 4 active; 

• and x = (6,O),0*(x) = -36, constraints 2 and 3 active. 
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The global optimum, the optimum of all the local optima, is at 

x = (6,0), Ob{x) = -36, with constraints 2 and 3 active 

A good SQP algorithm would be one which would find all the local optima 
at intersections of the constraint boundaries and then the designer would inspect 
5 these and find the best answer from them. At this point he may also wish to take 
additional considerations into account. 

Additional plots can be used to further interrogate the data. First, a series 
of scatter plots can be drawn as shown in Figure 3, in which every item of data 

10 can be plotted against every other item of data that is, of every dependent and 
independent variable of interest against every other variable. Scatter plots are 
widely used by the statistics community, see for example [10]. These plots 
enable a good appreciation of the design space and to establish whether or not 
known trends are being followed. This process confirms for instance the nature of 

15 the design of experiments (DoE). Here, design variable 1 and design variable 2 
are chosen at every corner point of a mesh, which subdivides the design space 
equally. The quadratic nature of the constraints is also discernible. Alternatives to 
this include parallel co-ordinates [11, 12] or SOM's). These latter methods also 
enable relationships between variables to be obtained [14] and, possibly, to 

20 establish the most important variables in the problem. 

Figure 4 shows a set of SOM's for this data. The directions of x* and x 2 
are horizontal and vertical respectively, showing that they are orthogonal in the 
design space. The objective (-Xf 2 -x 2 2 ) is monotonically related to c 2 as the 
diagonal lines go in the same directions and the colour changes from bottom left 
25 to top right. Xf and ci are shown to be inversely related as the colours are in the 
opposite directions, but still horizontal in both maps. Similarly c 3 is inversely 
related to x 2 . The functions c 1f c 2 , c 3 and the objective are all circular. (See U.K. 
patent application No. 0228751.4). 

Although the SOM appears to be able to detect relationships between 
30 functions it does not facilitate the scrutiny of play off between domain constraints. 
In addition the location of function minima is also desirable, along with tracking 
the paths of optimisations. These properties can all be identified, for a 2- 
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dimensional problem in Figure 2. An alternative representation of Figure 2 is 
shown in Figure 5. Note that in the Figure the feasible region is denoted by the 
white circles and the infeasible by the black circles. The full extent of the 
constraints is also shown. Thus, the complete domain is shaded and the feasible 

5 and infeasible regions are determined by the colour of the circles. The circles 
represent the DoE and are drawn for every other point in the design space. The 
complete extent of the constraints is shown. This representation follows the 
annotation of Grossman et al [16], in which a 28 dimensional space is 
represented as a triangle. The triangle in [16] is a mapping of 28 dimensional 

10 vectors into 2-D, 3 points are chosen to form the corners of the triangle. These 
may be local optima or perhaps two local optima and one intermediate point. All 
the intermediate points are then obtained as being a certain distance away from 
these reference points. The actual objective and constraints are then plotted as 
usual in a 2-D plot. A fourth reference point would then be required to turn the 2- 

15 D representation into a solid object. This technique necessarily incurs a loss in 
data structure, and a triangle is a relatively complicated mapping, particularly in 
higher dimensions. To understand the limitations of this method this mapping is 
presented for the circular function in Figure 6 and can be compared directly with 
Figure 5, except that the extent of the colour map is reduced in the triangular 

20 representation. Additional points outside the triangle could also be obtained by 
extrapolation. Note that in Figure 6 the optima at x=[6,0], x=[5,2] and 
x=[2. 116,4.174] form the corners. Intermediate points are obtained by 
interpolation. Although this transformation could provide some appreciation of a 
high dimensional space the problem with it is that the space extent is unknown. 

25 As such it can be used to appreciate space around known points in the domain, 
but whether all the optima are captured or the required amount of space has 
been visualised is not known. 

A transform is required which has a better 2-D manifold. The SOM is a 
projection and visualisation of a high-dimensional signal space on a two- 
30 dimensional display. Therefore it should be possible to use the SOM rather than 
a triangle for the 2-D manifold. Returning to the SOM it is clear that the 
tessellated hexagons used previously are relatively coarse. In fact, a much finer, 
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rectangular definition is possible. The equivalent SOM to Figure 5 is next shown 
in Figure 7. However, the SOM is found not to give very good results and the 
mapping from topographic space to the data space is only defined at the location 
of the nodes. 

5 The Generative Topological Mapping (GTM) is intended as an alternative 

computation of the SOM, in an attempt to define the metric relations between the 
models on the map grid with improved fidelity to those in the data space. The 
trade-off is a higher computational cost. The equivalent GTM to Figure 5 is 
shown in Figure 8. The orientation of these maps is always somewhat arbitrary, 

10 so rotation through 90 degrees anticlockwise shows a very similar representation 
compared to Figure 5. This transformation will now be applied to a military aircraft 
design problem. 

Military Aircraft Design Problem Specification 

The problem is to minimise the drag coefficient (C D ) of a representative 
15 Military Aircraft trapezoidal body/wing tail-less aircraft in cruise at M=0.85, 
subject to: 

5-D Problem: 

-3.0 < wing linear twist (washout, 0) < 7.0 
-3.0 £ wing angle of attack (a) £ 7.0 

0.0 < mid - camber <, 0.07 

0.0 <, flap deflection angle (6) <, 1 0.0 

9.557 <, leading edge (/.<?.) tip location £ 14.227 
C L > 0.1994 

C mtgaU =C mh + hC L cosa + hC D sin a 

~c,= C ^ a > = 1.0 

C D tana + a 3 

A cos a 

8-D Problem: 

-0.01 < Root Camber at 30%c < 0.025 
-0.01 <, Root Camber at 60%c ^ 0.04 

20 

-0.01 £ 50% Semi-span Camber at 30%c <, 0.025 
-0.01 £ 50% Semi-span Camber at 60%c £ 0.04 
-0.01 <, Tip Camber at 30%c <> 0.025 
-0.01 <, Tip Camber at 60%c <, 0.04 
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0' < a < r 
-y<o<>y 

subject to the constraints: 
C L X). 1994 and |CJ<0.02 

14-D Problem: 

-0.0 1 < Centre line Camber at 20%c <, 0.02 
-0.01 << Centre line Camber at 40%c <, 0.03 
-0.01 < Centre line Camber at 70%c <, 0.03 
-0.01 <: 40% semi-span Camber at 20%c <, 0.02 
-0.01 < 40% semi-span Camber at 40%c £ 0.03 
-0.01 < 40% semi^pan Camber at 70%c £ 0.03 
-0.01 £ 70% semi-span Camber at 20%c £ 0.02 
-0.01 <> 70% semi-span Camber at 40%c <> 0.03 
-0.01 <> 70% semi-span Camber at 70%c £ 0.03 
-0.01 < Tip Camber at 30%c < 0.02 
-0.01 ^ Tip Camber at 50%c <, 0.03 
-0.01 ^ Tip Camber at 60%c <, 0.03 
r < a < T 
-y<0£3' 

subject to the constraints: 
C L >0.1994 and |C m |<0.02 

5 where C L is the lift coefficient and C m the pitching moment coefficient. 

CFD evaluations are performed using the BAE SYSTEMS in-house code 
FLITE3D [8] in inviscid, Euler mode. 

Visualisation 

10 Figure 9 shows a visualisation of a related two-dimensional design space, 

with computational noise and failed evaluations. (Here, a simpler solver is used 
with two trailing edge parameters to reduce the computational cost so that a large 
number of evaluations is possible.) This corresponds to 50x50 evaluations of a 
two-dimensional design space (C D at C L =0.71, M=0.74) using a 2-D panel 

15 method. The two-dimensional design space describes the vertical movement of 
two B-spline poles adjacent to the trailing edge of an aerofoil. Computational 
noise often causes ridges in the design space, see also, for instance [9]. It is 
clear that gradient searches in this domain will not find the global optimum, but a 
local one, stopping at the bottom of a ridge. These problems are likely to be 



XA1762PCT 



-13- 

amplified in higher dimensional space. Inability to visualise high dimensional 
spaces can lead to an inability to fully exploit the additional flexibility. 
Computational noise and expensive evaluation naturally leads to the use of 
response surface methodologies in design space optimisation. 

5 Figure 10 shows the scatter plots for the 5-D military aircraft problem. In 

these, for instance, the quadratic nature of the relationship between C L and C D of 
every dependent and independent variable in the 5-D problem against every 
other variable can easily be identified. Additionally the independent variables 
show no relation with each other as should be expected given the DoE used to 

10 collect the data. 

Figure 1 1 shows a set of SOM's for the 5-D military aircraft problem. To 
orient oneself with the SOM's it is necessary first to look at the picture of the 
glyphs shown top right. In this image, each of the glyphs is placed according to 
the value of a, 0and S and are coloured according to the value of C L . The SOM 

15 is a diagrammatic representation rather than a physical map of the design space, 
as illustrated by comparison between the SOM of C L and the glyph image: the 
trends of the data are the same and have similar features. Consider the C L SOM 
tile, it varies from red through green to purple across the diagonal. In the glyph 
image, the same variation can be seen from top left to bottom right. In the SOM's 

20 the diagonal trends of the maps of C D , C L , C m , trim and a show that they are all 
related (C Dt C Ll amonotonically and inversely to C m and trim). The SOM's also 
show that the independent variables in the problem are unrelated, as they should 
be, given a suitable DoE. In higher dimensional problems, the SOM has been 
shown to indicate the first two principal components, as their SOM's can be 

25 related although in opposite directions (e.g. in opposite diagonal directions or 
vertically and horizontally). Bland regions in the SOM give an indication of rogue 
data (e.g. from unconverged CFD evaluations) and completely bland SOM's can 
help to identify unimportant variables. 

Figure 10 and Figure 11 are not easy to interpret, and the next question is 
30 whether or not the type of visualisation presented in Figure 2 can be extended to 
higher dimensions to provide equally useful information. 200 CFD evaluations 
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were used to obtain the Krig. Figure 12 shows a hierarchical axes technique 
(HAT) plot after [15] noting that filled squares denote optima located in the model 
using different optimisation methods. The other squares show the locations of 
evaluations in the final stages of simulated annealing of the response surface. 
5 The value of C D is coloured within the tile. Colouring does not take place if the 
inequality constraint on C L is violated. The contour lines are contours of trim 
constraint. As shown in the Figure, within an individual tile camber and S vary. 
As one goes from tile to tile in the horizontal direction of the main plot 0 varies 
and in the vertical direction a varies. Then the top 81 tiles of this image represent 

10 the highest value of the fifth design variable, leading edge tip location. Each block 
of 81 tiles going down then represent lowering values of leading edge tip location. 
Only the top of this image is presented so that the smaller tiles are seen clearly. 
Two optima are shown: the first the result of a simulated annealing optimisation 
(red square) and the second the result of an exhaustive search in the 

15 representation data. This visualisation is similar in spirit to the triangles used in 
Figure 6 and [16], but with a less complex design space transformation. The HAT 
plot can however, only be used for data appreciation in up to 6 dimensions, as 
the tiles become too small thereafter. This picture is only possible because 
response surface methodologies enable the large amount of data required for 

20 plotting to be provided. The image gives confidence that the same optimum is 
being located in both cases and that the curve fit is well behaved. 

Results from the RSM Kriqinq Process 

To validate the RSM Kriging procedure some results from this process are 
given in Table 1 . The variation in the results given in Table 1 could be cause for 

25 concern, except that reference to the visualisation shows that these results are 
close to each other and are therefore close to the same optimum. The CFD result 
is significantly different from the RSM, which means that there is mileage in 
building a new model, including this optimum and iterating until the optimum and 
CFD result obtained converge. The loading distribution and geometry of the final 

30 configuration are shown in Figure 14. In this case the loading distribution is 
nearly elliptic, as required, except for the compensation for wave drag in the 
outboard wing. The sweep is reduced compared to the initial configuration as 
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large amounts of sweep give a large amount of downward pitching moment, 
which has been reduced. During a large number of optimisations of similar 
design spaces, in general there seem to be two optima in these design spaces. 
The second is an optimum in which the result is below the elliptic loading 
5 distribution at the root and above it at the tip. This has a deleterious effect on root 
bending moment (i.e. increases it) and hence the structural optimum is worse 
and so in general the aerodynamics community chooses the answer presented 
here. 

The GTM in the 5-D problem 

10 Instead of Kriging the three design parameters of interest separately, in 

the SOM and GTM all the parameters of interest: the design variables, the 
objective and the constraints are transformed into the lower dimensional space 
y(x,W). The thesis in which the GTM is developed [18] offers the visualisations 
posterior mean and mode projection, the responsibilities and the magnification 

15 factors. This latter plot is a single image representing y(x,W). However, instead 
the inventors use the individual components of the vector y(x,W) pertaining to the 
variables of interest in the problem. From these components the penalty function 
can be obtained and plotted, with contours of C L and trim, where p(x) is given 
by: 

20 p(x)= C,+\c l -l$+<{C^-C L )/C i ^>. 

Where <> are MacCauley brackets, in which the contents become zero if 
the function therein is negative, else the value of the function is used. 

Figure 13 shows an image map representation of transformed data in 2-D 
latent design space y (x,w) in accordance with an embodiment of the invention. 

25 More particularly, this image map representation is provided by application of the 
GTM transformation for the 5-D aircraft design problem. Note that the penalty 
function is shown in the Figure, obtained from a combination of latent spaces for 
Cl, Co and C m , with contours of the latent spaces of C L and trim. The cross 
marks the optimum, that is the point where C D is the lowest and both C L and trim 

30 are satisfied. Here, a 60x60 latent space of isxis radial basis function (RBF) 
centres was used. Transformation back into real space gives the corresponding 
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values of x 1f x 2 , x 3 , x 4 and x 5 . These results are given in Table 2. The agreement 
between the CFD and GTM is excellent and the result is better than the 
preliminary result obtained using Kriging. Comparison between the GTM and 
Kriging results is also shown in Figure 14. This Figure shows a loading 
5 distribution of optimised wing design using kriging and the 5-D inventive GTM in 
accordance with an embodiment of the invention. Also shown are the starting 
and final CFD models. The GTM result is better as it is closer to an elliptic 
loading distribution. The new point could also now be used to build a new GTM, if 
desired, as the optimum could be used to build a new Krig model. 

10 Use of the GTM for higher dimensional optimisation 

The GTM was also used to optimise aerodynamic design spaces in 8 and 
14 dimensions. In both cases a 60x6olatent space was used with 30x30 RBF 
centres. The visualisations are shown in Figure 15 and Figure 16 respectively. 
Note that Figure 15 is shown orientated in such a way to show similarity to the 

15 14-D GTM shown in Figure 16. The solution to the 8-D problem is at x*= 0.05058, 
x 2 = 0.01256, x 3 = 0.005531, x 4 = 0.00668, x 5 = 0.00953, x 6 = -0.00360, x 7 = 4.8462, 
x 8 = 1.7266, with the GTM model after a number of iterations and the CFD 
solution being C t = 0.2022, C D = 58.83 counts, C m = -0.00359661. This is 
probably reasonable compared to other optimisations, for instance a 3-D gradient 

20 search also gave C D = 58.8 counts, with C L =0.1994 and C m =-0.02 (higher C L and 
lower C m in this case), although there is probably more to come as the GTM 
solution is not on the boundary. This could possibly be found using a gradient 
search. The GTM in conjunction with an optimisation method does not seem to 
work as well in 14-D as in lower dimensions. It is probable that this is because 

25 the transformation is doing more i.e. going from 14-D to 2-D. To ameliorate this it 
should be possible for higher dimensions to transform to 4-D and view using the 
HAT plot discussed previously. The distinct similarities between Figure 15 and 
Figure 16 are evident and significant because they show that the same problem 
is being solved in both cases. It may assist in the future when trying to ascertain 

30 whether or not more limited sets of design variables can be used to adequately 
represent problems to compare the 2-D design spaces of both the lower and 
higher dimensional representations of the problem. 
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Figure 17 shows a Hierarchical Axes Technique (HAT) plot of the 6D 
Hartmann function [Dixon and Szego [21]]. This function is a multimodal function 
with two identifiable local optima. As shown in the Figure, the 4D GTM 
transformation can be used to obtain an improved optimum over the 2D GTM 
5 transformation. Note that the 2D GTM and 4D GTM results are represented by 
circles and diamonds, respectively. 

Figure 18 shows another image map representation of transformed data, 
as obtained from a 2D GTM transformation of the 6D Hartmann function. As 
shown, the optima are represented by triangle symbols. Note that the triangle 
10 symbols correspond to the 2D GTM circles as shown in the HAT plot of Figure 
17. 

Figure 19 shows another image map representation of transformed data, 
as obtained from a 4D GTM transformation of the 6D Hartmann function. As 
shown, the optima are represented by triangle symbols. Note that the triangle 
15 symbols correspond to the 4D GTM diamond symbols as shown in the HAT plot 
of Figure 17. The advantage here is that more information can be retained 
because the transformation step in going from 6D design space to 4D design 
space is less than that in going from 6D design space to 2D design space. 

Figure 20 shows yet another image map representation of transformed 
20 data, as obtained from 4D GTM transformation of the 14D aircraft problem. As 
shown, the optimum is marked by a white square symbol. 

Other Potential Applications of the GTM in Design 

During the kriging process it is possible to merge high and low fidelity data 
results. Plots of such data would show similarities and differences in the GTM. 

25 Previous work has considered the use of the GTM in design space search, 

see [19]. However, here the SOM and GTM are used to predict how a low fidelity 
model relates to a high fidelity analysis. This inventive work does not consider the 
optimisation process per se in the lower dimensional representation. In [19] El- 
Beltagy indicates that the GTM algorithm can also be used as a visualisation tool 

30 to understand the discrepancies between the models and so reformulate the 
optimisation problem, although he does not show how. 
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Conclusions 

A 2-dimensional plot generally provides the best data visualisation. 
Multiple dimension data needs to be transformed to lower dimensions to enable 
this. The HAT plot visualisation along with the RSM technology enables 
5 visualisation in up to 6 dimensions. The GTM has been shown to provide 
adequate visualisation and a quantitative graphical method for optimisation up to 
14 dimensions. However, the step from 14-D to 2-D may be too large and 
therefore a 4-D GTM may be more accurate. More points in the 14D RBF and 
latent space may also improve the GTM. 

10 Visualisation technology helps the designer to spend time inspecting 

results and ensuring correctness rather than dealing with large volumes of flow 
data. After a large number of numerical evaluations have been performed there is 
a need to identify any off trend results. The scatter plot method presented here is 
ideal for this purpose. The SOM also helps with this to give an overview. 

15 Response surface method technology eliminates inefficient design space 
sampling in the final stages of a gradient search optimisation. A balance is 
required between the number evaluations in the DoE, the number of cycles in the 
CFD, the number of points in the initial DoE and the number of further 
evaluations used. The trade-off between low-dimensional comprehension and 

20 high-dimensional accuracy impacts optimisation. 

These type of visualisation methodologies are utilised to support design 
decisions such as the relative scaling of the design variables and constraints and 
choice of penalty function, which are important in optimisation. Also possible is 
the recognition of problems such as numerical noise and boundaries of 

25 evaluation failure. Initial design of experiments can be improved in a systematic 
way by calculation of additional points dictated by maps of statistical and other 
error criteria. Significantly, the invention has utility for various aircraft design 
applications. Also, the invention can be embodied in software, if desired. 
Although this technology has been developed with reference to aircraft 

30 aerodynamic design in particular, the design space visualisation and curve-fitting 
technology developed is general. It should therefore be equally applicable to 
other disciplines such as cost analysis, structures and computational 
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electromagnetics, in which expensive analysis tools are used to find optima for 
complicated design problems. It is expected to be particularly useful in multi- 
disciplinary design and situations where there are multiple optima in the design 
space. 

5 Having thus described the present invention by reference to several 

preferred embodiments, it is to be appreciated that the embodiments are in all 
respects exemplary and that modifications and variations are possible without 
departure from the spirit and scope of the invention. For example, whilst in the 
described embodiments the transformed data in the low-dimensional (2-D) image 

10 map representations are visually inspected, it is equally possible for the 
inspection to be performed computationally. It is to be also understood that the 
described inventive transformation technique can be effectively applied to a wide 
range of high-dimensionality design spaces and that the transformation of data 
can be suitably performed into any one of a wide range of low-dimensionality 

15 design spaces. 

It is to be also appreciated that whilst the GTM transformation technique is 
applied in the described exemplary embodiments, it is equally possible to use 
alternative transformation techniques, SOM or Neuroscale for example, instead 
of GTM, so as to realise the inventive technical effect. 



20 
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Appendix 1 Kriainq 

Here, a Kriging approximation using a Gaussian kernel has been used to 
perform the RSM surface fits, see for instance in Sacks [5] or Jones [6,7]. If y is 

an (nx1) vector of responses evaluated at the locations X s , i=1,...,n, where n is 

5 the size of the DoE, then the response at the unsampled points x * is an 
estimate given by: 

Kx*) = M+r r R- 1 (y-l^) 

where: 

1 is the vector of ones and ^ is a weighted mean given by: 
. l T K l y 

with: 

r being a correlation vector based on the measured and estimated 
sample points, X * , 

R is a matrix of correlation coefficients, based on the ' data points 

/. -va Corr\x,,xA , i ;* , 

the (1,7) entry of R is given by ' 1 and the * element of 

k Ph 

Corr[ Xi , Xj ] = exp[-X 1 0 0 > \x hJ -x h J ] 9 l > 0, / = 1, . . . , k > 

h=\ 

for a sample of k variables at n points. 

The hyperparameters 6 ht p h and the factor on w min in SVD (if used) are 
20 optimised by maximising the likelihood function or minimising: 



15 
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- 1 

2 



-2 . 



Where the variance, tJ , is given by: 

(y-l|X) r R- ! (y-l|I) 



& 2 = 



n 



Giving the mean square error of the predictor as: 

(l-l T R _1 r) 2 



s 2 (x*) = <T 2 



l-r r R _1 r 



1 T R-1 



Finally, the expected improvement is given by: 



*[/(*•)]■ 



if the constraints are satisfied 
else 



Here, y m/ >, is defined as the minimum of the input data, which satisfies the 
constraints. When considering minimisation, Expected Improvement can have its 
10 maximum value where the data is sparse or the approximation has a low value. 
The strategy is to resample where the Expected Improvement is maximised, then 
to form a new approximation and repeat. 

Where the standard normal density and normal distribution functions are: 



(*(x) = 



1 ~ 



4ln 



and 



<D(x) = J 



1 



4l7U 



du 



If the Euclidean norm is given by ||z|| the linear and thin plate spline radial 
basis functions are given as: 



Corr[x i ,x j ] = \\z 



Corr[ Xi ,Xj] = ||z|| 2 log(||z||) 



r 
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10 



15 



These Equations do not provide kernels suitable for tuning or error 
analysis with statistical interpretation. It should be noted that alternative kriging 
algorithms are also widely used, which use the variogram instead of the 
correlation, see for example [17]. 

Appendix 2: Summary of the GTM algorithm 

The GTM is a non-linear parametric mapping y(x,W) from an L-dimensional 
latent space to a D dimensional data space, where normally, L<D, as illustrated 
in Figure 21. The sequence of steps for constructing a GTM model is given in 
[18] as: 

Generate the grid of latent points: { x k } » k = 1» • • • 

Generate the grid of basis function centres: {M m } » m = 1 » • • • »M . 

Select the basis function width a. 

Compute the matrix of basis function activations, O. 

Initialise W, randomly or using PCA. 

Initialise ft. 

If desired, select a value for a. 



Compute A, A kn = ||*„-O a W|| . 
Repeat 

Compute R using A and fi. 
Compute G using R. 



E-step 



20 



W = (O T G0> + 3J) _1 0> T RT, where Z may be zero. 

Compute A, \„ = ||*„-<I>,W| 
Update /?, using R and A. 



M-step 



Until convergence 



t 
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The squared distances required to update in the M-step gets 'reused' 
when calculating the responsibilities in the following E-step. In our case we use 
the implementation of this formulation by Ian Nabney of Aston University in 
Netlab, [20]. 



